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The Extrapolation of Families of Curves by 
Recurrence Relations, With Application 
to Creep-Rupture Data 

A method using finite-difference recurrence relations is presented for direct extrapolation 
of families of curves. The method is illustrated by applications to creep-rupture data 
for several materials and it is shown that good results can be obtained without the 
necessity for any of the usual parameter concepts. 


Introduction 

The problem of extrapolating sets of data finds 
many applications in engineering practice. An example which 
will be treated in detail in this report is the extrapolation of 
short-time creep-rupture data to predict long time life. 

The present day techniques for the extrapolation of creep-rup- 
ture data are based primarily on the time-temperature parameter 
concept. It is generally assumed that all creep-rupture data for 
a given material can be correlated to produce a single master 
curve using as one of the co-ordinates a parameter involving a 
combination of time and temperature. This master curve which 
can be obtained using primarily short time data could then be 
used for extrapolation to long times. The three best known 
parameter methods are the Larson-Miller, Manson-Haferd, and 
Dorn parameters [1 to 3]. 1 

These parameter methods have the great advantage that, at 
least in theory, they require only a relatively small number of 
data to establish the required master curve. In particular, the 
development of the objective least squares method in reference 
[4 ] makes it possible to obtain the optimum constants contained 
in the parameters described in references [1 to 3] without plotting 
and crossplotting the data and with the use of a minimum of 
judgment on the part of the analyst. 

On the other hand, an alternative to the parameter methods 
would be advantageous for several reasons. First, these parame- 
ter methods presuppose a knowledge of the existence of some 
form of functional relationship between the variables. Thus it 
is assumed that, at a constant nominal (initial) stress, the loga- 
rithm of rupture time is linearly related to the temperature, for 
the Manson-Haferd parameter, and to the reciprocal of the abso- 
lute temperature for the Larson-Miller and Dorn parameters. 
For most materials it has been found that such relationships are 
valid in the range of variables investigated. In particular, the 
Manson-Haferd parameter has been shown [5 and 6 ] to give best 
results in the majority of cases. However, occasionally materials 
are encountered for which none of the parameters are valid. 
For example, plots of the logarithm of rupture time against 
temperature or reciprocal of absolute temperature at constant 
nominal stress will not result in straight lines for crucible 422 
steel [7]. In these cases, modification of the parameter methods 
is necessary [7]. 

1 Numbers in brackets designate References at end of paper. 
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Secondly, the parameter methods in their usual form give equal 
weight to all the data, whether they be low time or high time 
data. For extrapolating to long times more weight should be 
given long time data. The method to be presented attempts to 
overcome these objections as well as providing an independent 
check on the parameter methods. 

The method presented in this paper enables one to extrapolate 
directly a family of curves such as creep-rupture curves without 
assuming any particular parametric form. The method is based 
on the assumption that a family of curves such as a set of iso- 
thermal curves can be represented approximately by a finite-dif- 
ference recurrence relation. Once the coefficients of this recur- 
rence relation are determined, it is a simple matter to extrapolate 
each member of the family individually. The method has the ad- 
vantage that it does not require an explicit knowledge or as- 
sumption as to the analytic character of the curves or as to what 
parametric form to use to correlate the data, although implicitly 
it assumes any of the broad class of functions which satisfy linear 
finite-difference equations. It is thus much more general in na- 
ture than the parametric methods previously discussed and can 
be used by itself to extrapolate creep-rupture data or as an inde- 
pendent check on any of the parameter methods. In addition, 
the method treats the data in such a way as to give more weight 
to the higher time data than to the lower time data. 

Several examples of the use of the method are described in de- 
tail in the body of the paper, and the results of this type of ex- 
trapolation on the creep-rupture curves of several materials are 
presented. The use of this method is, of course, not restricted to 
creep-rupture data, and several examples of other type curves 
such as Bessel functions, Legendre polynomials, and power func- 
tions, are presented. 

Method 

The usual method for extrapolating a curve is to assume some 
explicit functional relation between the ordinate y and the ab- 
scissa x. The present method assumes instead a linear relation 
between successive equally spaced ordinates without directly 
introducing the abscissa x. Thus consider a section of a curve 
such as the solid line from 0 to 60 deg in Fig. 1. This section is 
actually part of a sine curve; however, assume that this is not 
known and that it is desired to extrapolate the curve. This can 
be done in several ways and, as previously mentioned, the one 
that is generally used is to fit the known curve by some assumed 
function and to then use this function for extrapolation. For 
example, a polynomial such as a parabola or cubic can be fitted 
to the curve. While assumptions of this type usually yield very 
good values when interpolating they are usually poor in extrapo- 
lating more than a short distance beyond the end of the curve. 
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Table 1 Extrapolation of sin x 


X , deg 

sin x, extrapolated 

sin x, exact 

0 


0 

10 


0.1736 

20 


0.3420 

30 


0.5000 

40 


0.6428 

50 


0.7660 

60 


0.8660 

70 

0.9397 

0.9397 

80 

0.9840 

0.9848 

90 

1.000 

1.000 

100 

0.9848 

0.9848 

110 

0.9396 

0.9397 

120 

0.8658 

0.8660 

130 

0.7657 

0.7660 

140 

0.6423 

0.6428 

150 

0.4993 

0.5000 

160 

0.3411 

0.3420 

170 

0.1725 

0.1736 

180 

-0.0014 

0 

200 

-0.3439 

-0.3420 

220 

-0.6451 

-0.6428 

240 

-0.8685 

-0.8660 

260 

-0.9871 

-0.9848 

280 

-0.9864 

-0.9848 

300 

-0.8666 

-0.8660 

320 

-0.6421 

-0.6428 

340 

-0.3401 

-0.3420 

360 

0.0031 

0 


If, however, the sine function were chosen to fit this curve, then 
in the foregoing case it would obviously give excellent results. 
Thus, although for interpolating purposes it is possible to fit a 
curve by many different functions, the extrapolated values will, in 
general, be very sensitive to the function used. 

The present method avoids this difficulty by working directly 
with successive values of the ordinates of the curve rather than 
assuming any functional relation between the co-ordinates. A 
linear relation is sought between successive ordinates on the 
curve of the following form 

y% = Aiyi-i + Myi-i + . . . . + (i) 

where y { represents the value of the dependent variable at the end 
of the ith interval, and the A j are constants to be determined. 
Equation (1) gives the value of the ordinate at the ith station in 
terms of the values at the q previous stations. Once the value at 
the ith station is computed, this value is used together with the 
q — 1 values preceding it, to calculate the value at the (» -f- l)st 
station. In this way successive ordinates can be computed in 
terms of the previous ordinates. 


h- 1 RANGE OF DATA USED FOR EXTRAPOLATING 

° THEORETICALLY exact values 

EXTRAPOLATED VALUES, q * 2 

EXTRAPOLATED VALUES. q = 3 OR 4 

p 0R Q = 3. y, = 3 5020 y ( _, - U 0535 y, 2 ♦ I 5507 y,. 3 

A. * ^ 

TEMP, 



Fig. 2 Results for theoretical stress-rupture curves given by 


log a = 5.131 


r T — 600 

|_81. 8(9.5 - log f)J 


Equation (1) can, for example, be obtained from a differential 
equation. Thus, consider the differential equation associated 
with the sine function 


<Py_ 
dx 2 


+ V- 0 


writing (2) in finite difference form gives 


y.+i - tyi + i/i-i 
( A *) 1 


+ Vi = 0 


( 2 ) 


or 


y i+l - [2 - (Ax)*]y, - y w (3) 

which is an equation of the form of ( 1) relating the ordinates of the 
sine curve to each other. In the general case, of course, the dif- 
ferential equation for the curve is not known. The coefficients 
A i appearing in (1) can, however, be obtained from the ordinates 
of the curve by least squares as will be subsequently described. 

One additional assumption is necessary in order to apply the 
present method to a family of curves. Just as equation (3) is 
valid for any one of an infinite family of sine curves of the same 
frequency (the members of the family can have different ampli- 
tudes or different phase angles), so it will be assumed in general 
that all the members of the family of curves to be extrapolated 
are represented by the same recurrence relation of the form of 
(1). A more extensive discussion of the origin and validity of 
equation (1) is given in the Appendix. 

In order to determine the coefficients A i of equation (1) use is 
made of least squares. Consider a family of curves to be ex- 
trapolated as for example in Fig. 2. In general, these will be ob- 
tained by fairing by eye the best curves through the data points. 
Choose n equally spaced stations for each member of the family. 
(These stations need not be chosen at the same values of the 
abscissas for every member of the family, but the spacing must be 
the same.) Choose the order q of the recurrence relation to be 
used (usually, q = 3 or 4). For each member of the family write 
a recurrence relation of the form of (1), as follows 
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I / A (l) = -4 i2/*-i (1) + + Azjjkr- 3 (1) + * • • + A ? t/*_ g (I) 

t/*< 2 > = 4- A 2 y*- 2 <*> + Aiy^ + . . . + 4 fl 2/*- 9 (a) 


(4) 


j/* <m) — Ait/fc-i (m> + A 2 yk-^ m) + Azy k -z {m) + •• • 

+ A g y^ m > 


where y k {V) represents the value of the dependent variable at the 
end of the fcth interval and the superscript represents the member 
of the family under consideration. It should be noted that q can- 
not be greater than the number of intervals chosen. 

The A j are now chosen so that the recurrence relation (4) will 
best represent the data in the given range. To do this the usual 
least squares method of minimizing the sum of the squares of the 
residuals is used. Thus, the following sum is here minimized 

m n 

S = X) W”' - - -'UWr*™ ~ 

V ~ 1 * = 9 + 1 

(5) 


Differentiating S with respect to each of the A j and setting the 
results equal to zero, to find the optimum values of the results 
in the following set of simultaneous equations for the coefficients. 


T\\Ai + r n A 2 4- . . . + r iq A q = ri 0 
r±\Ai + r 22 A 2 4" . * • 4- r 2q A q = r M 
; ; ; (6) 

r Q \A\ 4- r q *At 4- ♦ . • 4- r qq A q = r 
where the coefficients r i; are given by 

m n 

r a = X! S vt-i (p) yk-i {r) = (7) 

p«l k=q+l 

Once the Aj are determined from (6), each member of the family 
can be extrapolated using (4), as previously explained. 

Examples 

As a first illustration consider the simple case of extrapolating a 
single sine curve as shown in Fig. 1. The values of the sine func- 
tion are assumed to be given between 0 and CO deg and it is de- 
sired to extrapolate by the method presented herein. Choose 
seven equally spaced stations so that 

yi — sin 0° = 0 2/5 = sin 40° = 0.6428 

y% = sin 10° = 0.1736 . y t ^ sin 50° = 0.7660 

yi = sin 20° = 0.3420 y 7 = sin 60° = 0.8660 

yi = sin 30° = 0.5000 

Let q = 2 then from (1) 

Vi - A\yi~\ 4- Aiyi- 2 

and from (7) 

7 

n 1 - ^2 y ^ 2 = y^ + y $ 2 + y * 2 + y * 2 *+■ y * 2 

3 

7 

fl2 = 7 ji = ^2 Vk~iyh~2 ~ 2/22/1 4- 2/32/2 4“ 2/<2 h 4- 2/52/1 4- 2/62/6 

Jt = 3 
7 

r« = ^2 y*-* 2 ~ y i2 + y* 2 + y* 2 + y** 4- y* 2 

k = 3 
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no = ^2 y*-'y* = y*y* + 2/32/4 4- 2/42/5 + y*>y* 4- y©y 7 

k = 3 
7 

r w = ^2 y^y* = y*v* + 2/22/4 4- 2/32/5 4- 2/42/6 4- 2/52/7 

k = 6 

Substituting the values for t/i through r/ 7 gives 
r n - 1.3970488 
7*12 — r 2 i = 1.0441560 
r n = 0.81029280 
r 10 = 1.7075120 
r 20 - 1.2463024 

Substituting into equation (6) and solving gives 
A i = 1.96975 
A 2 = -1.00016 

Therefore 


= 1.969 752/ t-i - L00016 

Thus at 70 deg 

2/b = 1.969752/7— 1.00016 y t 

= 1.96975(0.8660) - 1.00016(0.7660) 


= 0.9397 

continuing this way the values of y ~ sin x have been computed 
up to 360 deg and compared with the exact values in Table 1 and 
Fig. 1. 

As a second example, a family of curves was chosen simulating 
a set of stress-rupture data. It was assumed that an equation can 
be written for this family similar in form to those proposed in 
reference [7]. 


y == log <7 = 5.131 — 


[ T - COO "] 2.9326 

81.8(9.5 - log 0. 


( 8 ) 


The curves represented by equation (8) are plotted in Fig. 2 
for four temperatures. Again take seven stations (n = 7) equally 
spaced from log t = 1 to log t — 3 as shown. The values of y* p) 
for these stations as computed from equation (8) are shown in 
Table 2. The r {j are now computed from equation (7). In this 
case we have a double summation. The products for all four 
curves (m = 4) must be added together. Thus, for example, tak- 
ing q = 2: 

7*12 = 2/2 (1) 2/l (l) + 2/3 (1) 2/2 U > 4- 2/4 (1) 2/3 (1> 4- 2/5 (1) 2/4 (1) + 2/6 (u 2/5 (1) + 
2/2 (2 ) 2/i (2) + 2/3 (2 W 2) 4- 2/4 (2) 2/3 (2) 4- 2/6 {2) 2/4 (2) 4- 2/6 (2) 2/5 (2) 4- 
?/2 (3 ) 2/i (3) 4- 2/3 (3 ) 2/2 (3) 4- 2/4 (3) 2/3 (3) 4- 2/5 (3) 2/4 (3) 4- 2/6 (3) 2/5 <3) 4- 

yi (4) yi U) 4- 2/3 (4, 2/2 (4> 4- 2/4 (4 W 4) 4* 2/s (4) z/4 (4) 4- y^ 4) y& (4) 


Table 2 

Values of log a 

= 5.131 - j 

" T - 600 "| 3.9326 

l_81.8(9.5 - 

log f) J 

T 

o 

O 

o 

1200° 

1300° 

1400° 

log t 





1.0 

4.751 

4.482 

4.111 

3.622 

1.333 

4.703 

4.401 

3.984 

3.434 

1.667 

4.648 

4.306 

3.835 

3.214 

2.000 

4.582 

4.194 

3.659 

2.953 

2.333 

4.504 

4.061 

3.449 

2.642 

2.667 

4.410 

3.900 

3.197 

2.269 

3.000 

4.296 

3.706 

2.891 

1.817 
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Once the r {j are computed, equation (6) is solved for the A i and 
the extrapolation is then carried out for each curve from the rela- 
tions 

Vi™ - A iVi ^ + A#**™ 

Vi™ = A lVi . !<» + 

J/i (3) = 

y< (4) - ^i2/»-i ( 4) + 4 2 2/i- 2 < 4 > 

The values obtained for this case were: A\ = 2.2052, As = 
— 1.2048. The results for this calculation are shown in Fig. 2. 

Results and Discussion 



tained using only a second-order recurrence relation (q = 2). As 
a matter of fact, little or no improvement can be obtained by 
going to higher values. However, this is to be expected since the 
governing differential equation is of the second order. It is seen 
from equations (2) and (3) that a recurrence relation with q equal 
to 2 is sufficient to describe the sine function. As a matter of fact, 
taking Ax equal to 10 deg or 0.174533 radians gives from equation 
( 3 ) 

Vi+i = 1.96954 - t/»_i 

hich is seen to be very close to the values previously obtained by 
the method presented herein. 

Fig. 2 shows the results obtained for the theoretical set of 


Fig. 1 and Table 1 show the results of extrapolating sin x by the 
method presented herein. It is seen that excellent results are ob- 


I {range of data used for 

EXTRAPOLATING 
O EXACT VALUES 
□ EXTRAPOLATION BY LARS0N- 
MILLER PARAMETER 

EXTRAPOLATION BASED ON 

yj« 3.5028 y M - 4.0535 yj . 2 + 1.5507 



Fig. 3 Results of extrapolating stress-rupture curves based on Manson- 
Haferd parameter by recurrence relation and Larson-Miller parameter 


| j RANGE OF DATA USED FOR EXTRAPOLATING 

O EXACT VALUES 

— EXTRAPOLATED VALUES BASED ON 

i- = 3.8861 yj_, - 4.8470yj_ 2 + l.9597y j _ 3 



Fig. 5 Extrapolation of curves based on Dorn equation 

60,000 
e,T +460 

c °- 14 (log «r) 1 * 8 == IQ-JO- — 


| | RANGE OF DATA USED 

FOR EXTRAPOLATING 
O EXACT VALUES 
□ EXTRAPOLATION BY M ANSON - 
HAFERD PARAMETER 

EXTRAPOLATION BASED ON 

[p Yj ■ 5.2069 yj. , - 5.A26A + 1.2196 



•RANGE OF DATA USED FOR EXTRAPOLATING 


O EXACT VALUES 

EXTRAPOLATED VALUES BASED ON 

V t - l.l22ty M + 75487 yj . 2 - .07699 yj . 3 



Fig. 6 Extrapolation of curves based on Conrad equation 


Fig. 4 Results of extrapolating stress-rupture curves based on Larson- 60,600 a 

Miller parameter by recurrence relation and Manson-Haferd parameter f = 3.24 X 10 ”• e 7 ’+460 e <ro{T) 
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o 


IRANGE OF DATA USED FOR EXTRAPOLATING 
EXPERIMENTAL DATA 

EXTRAPOLATED VALUES BASED ON 
yj = 2.0309yj.| - l.2402yj. 2 + .I9925yj. 3 


I 1 RANGE OF DATA USED FOR EXTRAPOLATING 

9 EXPERIMENTAL DATA 

EXTRAPOLATED VALUES BASED ON 

^ = I 4346y j . l + .050990yj. 2 ‘ .49l35yj. 3 


Ax = 0.3 



Fig. 7 Results of extrapolating alloy S-590. Data from?reference [6] • 

| H RANGE OF DATA USED FOR EXTRAPOLATING 

O EXPERIMENTAL DATA 

EXTRAPOLATED VALUES BASED ON 

y. = 1.7144 y M - .34493 yj_ 2 - .36901 y| _ 3 



Fig. 9 Results of extrapolating alloy A-286. Data from reference [6] . 

I 1 RANGE OF DATA USED FOR EXTRAPOLATNG 

o a on experimental data 

EXTRAPOLATED VALUES BASED ON 

y, * I 72l5y,.| - 73A62y„2 ♦ .0092285y,-s 



Fig. 11 Results for crucible 422 steel. Data from reference [7]. 


Ax = 0.2 


TEMP, 



Fig. 8 Results of extrapolating alloy Nimonic 80A. Data from refer- 
ence [6] . 


OC vO EXPERIMENTAL DATA 

I' t RANGE OF DATA USED FOR EXTRAPOLATING 



Fig. 10 Results of extrapolation for killed carbon steel. Data from 
reference [ 1 0] . 


| — ■ ■ - | RANGE OF DATA USED FOR EXTRAPOLATING 

EXTRAPOLATED VALUES BASED ON 

y { = l.3878y H - .14380^.2 - .260l4y. 3 

Ax = 0.3 



Fig. 12 Results of 18-8 stainless. Data from reference [2]. 
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creep-rupture curves as given by equation (8). The extrapola- 
tions were made with q equal to 2, 3, and 4, and it is seen that 
there is no significant difference between the results obtained for q 
equal 3 and those obtained for q equal 4. In both cases the 
extrapolated values up to a hundred thousand hours shows excel- 
lent agreement with the theoretically exact values. 

The generality of the present method for creep-rupture applica- 
tion was tested by trying it for several cases where one or another 
of the parameter methods could not be expected to give good re- 
sults. Thus if one took a set of data given exactly by the Manson- 
Haferd parameter equation (8) and tried to correlate and ex- 
trapolate these data by the Larson-Miller parameter, one would 
not expect to obtain good results. This was done as shown in Fig. 
3. Using the data exactly satisfying the Manson-Haferd parame- 
ter equation (8) in 10-1000 hour range, the best value of the 
Larson-Miller parameter C was computed by the method of 
reference [4]. The value of C was determined as 18, and a 
master curve was then constructed and the isothermals extrapo- 
lated as shown in Fig. 3. It is seen that as expected the ex- 
trapolation is very poor. However, using the same data between 
10 and 1000 hours, the extrapolation obtained by the recurrence 
relation method gives excellent results as previously shown in Fig. 
2 and repeated in Fig. 3. 

A second calculation was then made using the reverse proce- 
dure. A set of data exactly satisfying the Larson-Miller parame- 
ter was generated by the equation 

(log t + 1S)(T + 460) = 33,500(5.13 - log <r) 0 -™ (9) 

The data obtained by this equation are very close to those ob- 
tained from equation (8) in the range between 10 and 1000 hours. 
These data were then used to obtain the best values of the con- 
stants for the Manson-Haferd parameter and to construct a 
master curve which was then used to extrapolate the original iso- 
thermals. The results are shown in Fig. 4 and as expected the 
extrapolation by the Manson-Haferd parameter for this case was 
not very good. However, again as can be seen the extrapolation 
obtained by the recurrence relation, using the same data, is ex- 
cellent. 

The calculations shown in Figs. 3 and 4 indicate the greater 
generality of the proposed method. The recurrence relation tech- 
nique can be used whether the data are best fitted by the Larson- 
Miller parameter or the Manson-Haferd parameter. As a further 
test the method was applied to sets of data generated by use of 
the Dorn parameter and the recently proposed equation by Con- 
rad [8]. The results are shown in Figs. 5 and 6, and it is seen that 
the agreement is very good. 

In the previous examples the values of the ordinates required 
to calculate the r ij by equation (7) were precisely known, since 
they were obtained from exact mathematical expressions such as 
equations (8) and (9). It might be expected therefore that these 
input data would reflect implicitly the shape of the curves even 
at a distance relatively far from the initial range of the data used. 
In practice, however, the data are given experimentally, and the 
input data for equation (7) are therefore much cruder than in the 
examples given. The extrapolation in this case might therefore 
not be quite so good as previously indicated, particularly if the 
curves have a large amount of curvature in the extrapolated range. 

The method was therefore tried out using the actual creep- 
rupture data for six different materials. The actual data were 
plotted in the range to be used for extrapolating, and curves 
drawn by eye through these data. The values of the ordinates at 
seven equally spaced values of the abscissa were then read from 
these curves, and the coefficients of the finite difference recurrence 
relations obtained. The curves were then extrapolated and the 
results are shown in Figs. 7 through 12. It is seen that good ex- 
trapolation is obtained for all six materials. 

The materials in Figs. 7, 8, and 9 were analyzed in reference 


(range of data used for extrapolating 

O EXACT VALUES 

q = 3 yj s 2.9722*., - 2.9744*_ 2 + 1.0022 * 3 

q = 4 * = 2.3583*., - 1.1538*, - .81383* , 

+ -60932 y ._ 4 



[6], where a comparison was made between the. Larson-Miller, 
Manson-Haferd, and Dorn parameters. In evaluating the various 
parameters, reference [6] uses the standard deviation defined by 

where D is the standard deviation, d is the deviation of each data 
point, and N is the total number of data points. Part of the re- 
sults comparing the various parameters are reproduced in Table 3, 

Table 3 Standard deviations 


Material 

Larson- 

Miller 

Dorn 

Manson- 

Haferd 

Recurrence 

relation 

S-590 

0.351 

0.430 

0.324 

0.133 

Nimonic 80 A 

0.385 

0.235 

0.091 

0.045 

A-286 

0.207 

0.172 

0.134 

0.148 


In addition, the standard deviations using the method presented 
herein for extrapolation were also computed and added to the 
table. It is seen that the present method gives better results than 
any of the parameters shown. 

Inspection of Figs. 7 through 12 shows that this method gen- 
erally gives good results. However, a note of caution is in order. 
In order to use this method a sufficient number of low time data 
are needed for adequate definition of the basic curves to permit 
proper fairing. If such data are not available then the present 
method cannot be used. It should also be noted that the value of 
q or the number of terms appearing in the recurrence relation 
should not be made too large since it has been found that the 
larger the number of simultaneous equations to be solved the 
greater is the loss in significant figures in carrying out the calcula- 
tions. However, the results for the examples and materials shown 
indicate that in general using a value of q equal to 3 is adequate 
and that very little can be gained by going to higher values of q . 

It is obvious from the foregoing that this method is not re- 
stricted to families of creep-rupture curves. The sine function 
used as an example illustrates that other type curves can be ex- 
trapolated with equal ease. For example, Fig. 13 shows the re- 
sults of applying this method to a Bessel function, Fig. 14 shows 
the results for a Legendre polynomial, and Fig. 15 shows a family 
given by y = x n with n equal to Vs, V*, and la all these 
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o 


RANGE OF DATA USED FOR EXTRAPOLATION 
EXACT VALUES 

q s 3 y, - 2.9709yj_, - 2.9679 y;-2 + .99706 *.3 


Ax = 0.03 



Fig. 14 Extrapolation of Legendre polynomial, P&(x) 


(RANGE OF DATA USED 

' FOR EXTRAPOLATION 
o EXACT VALUES 
q = 4 y, = 2A286 y„, - 

+ A6A80 yj-3 * 


1.8892 yj _2 
0057130 yi . 4 



Fig. 15 Extrapolation of family of curves given by y = x n 


cases good results are obtained, even though as indicated in the 
Appendix one would not expect that these functions could be 
represented by finite-difference recurrence relations with constant 
coefficients. It is evident, therefore, that the applications of this 
method can be manifold. 


APPENDIX 

Origins of Finite- Difference Recurrence Relations 

Consider any nth-order ordinary linear differential equation 
with constant coefficients. It is apparent that if each of the 
derivatives appearing in the differential equation is replaced by 
its finite difference equivalence, a finite difference recurrence re- 
lation is obtained relating (n + 1) stations to each other. This 
has already been illustrated by the sine function discussed earlier. 
As another simple example consider the differential equation 


d*y 

dx z 


= 0 


( 10 ) 


in finite difference form this becomes 


Vi+ 1 ~ 3 Vj + 3t/j-i — t/i-2 

(Axy 


or 


Vi + 1 = 3 yi - Zyi-i + Vi-2 (li) 

which is the recurrence relation for a family of parabolas, the 
particular member of the family being determined by the starting 
values. In this particular case the relation (11) is exact since it is 
independent of the step size Ax. 

It is apparent that, for every family of curves which are 
derivable as the solution of a linear differential equation with con- 
stant coefficients, there exists a corresponding recurrence rela- 
tion. In the general case the recurrence relation can be said to 
approximate the actual function by a function which satisfies a 
linear differential equation with constant coefficients. Moreover, 
since the solution of an ordinary linear differential equation with 
constant coefficients or of the corresponding difference equation 
is generally given in terms of exponentials, it can be said that the 
actual function is being approximated by a sum of exponentials. 

There is, however, a great difference between the use of the 
finite difference recurrence relation proposed herein and trying to 
fit the curves by a sum of exponentials. Thus consider this re- 
currence relation 


Vi = A^yi-x -f Atyi - 2 (12) 

and the corresponding exponential solution 

y = Bxe a lX + Bte™ (13) 

Equations such as (13) have been used for interpolating purposes 
as, for example, in the Prony method [11]. Equation (12) con- 
tains two unknown constants which can be evaluated from four 
successive ordinates by writing down two such equations as (12) 
for two successive values of. i. Equation (13), however, requires 
the evaluation of four constants: B\ } B 2f ct \ , and a 2 . Moreover, 
these constants will in general be complex numbers. The genera- 
tion of the curve represented by (12) of course requires four 
values, Ai } A 2) t/,-i, and yi-t, just as for (13). 

This advantage of the use of (12) over (13) becomes even more 
evident if a family of curves is considered. Equation (12) re- 
mains the same with just two constants required, each member of 
the family being generated from its two starting values. The use 
of (13), however, requires the evaluation of a different set of con- 
stants B 1 and B 2 for each member of the family. 

The major advantage of (12) over (13), however, lies in the ease 
with which least squares can be used to determine the unknown 
coefficients. Using (12) one can find the best values of the con- 
stants to fit all the data by conventional application of least 
squares procedures. This case is brought about by the fact that 
the least squares equations are linear in the unknown constants. 
An attempt to find the best fit for all the data using (13) leads to a 
set of nonlinear equations in the constants to be determined which 
are difficult to solve. Furthermore, it has been shown [12] that 
the unknown constants in (13) are extremely sensitive to the 
accuracy of the input data. 

Another way of looking at these recurrence relations is in terms 
of weighting functions rather than as difference equations. Con- 
sider, for example, the problem of automatic fire control where it is 
necessary to point a gun not at where the target is, but where it is 
likely to be by the time the shell arrives. On the basis of the knowl- 
edge of the past path of the target, it is necessary to predict or 
extrapolate its future path. This problem has been handled in a 
very sophisticated way by Wiener [9] making use of autocorrela- 
tion functions and the modern techniques of operational calculus. 
Basically what is involved, however, is to obtain the approximate 
output of a given time series from a linear combination of the 
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input and a number of its past values. The output, thus, is given 
approximately by a weighted sum of a number of past values of 
the input. The coefficients in the recurrence relation can then be 
considered as weighting coefficients. 

To put it another way, in the linear theory of prediction an at- 
tempt is made to express f(t -f h) as a linear combination of values 
of/(/ — r) where/(0 is the function one wishes to predict, h is an 
interval of time in the future, t is the present time, and r > 0. 
One way of doing this would be to select several values of r, 

> 0 and choose coefficients A it so that 

n 

2 ~ T<) 

0 

gives an optimum prediction. This is precisely what has been 
done here. 
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tion, the curve given by equation (13) satisfies the second-order 
linear differential equation 

d ~ - (Oil + Oil) Y + ctiOti - 0 


For a second-order recurrence relation, the coefficients of the cor- 
responding differential equation may be found from the values of 
A i and A 2 by the equations 


ot\ 4 - a 2 


In (-At) 
(As) 


<X\Ot 2 


i |"i (Ai + y/ Ai 2 + 4 A 2 \ 

wL'n — i — ) 

In - Vi.’ + ^ j 


The determination of the constant-coefficient differential equa- 
tion corresponding to the recurrence relation is desirable in some 
cases. Because the data are to be physically significant, one of 
the requirements of the differential equation in order that it can 
properly represent the data is that it possess a real solution 
throughout the range of the independent variable. This require- 
ment implies that the coefficients of the differential equation 
must be real. As far as the recurrence relation is concerned, the 
Ai s always are real. However, the differential equation cor- 
responding to these real Af s may possess complex coefficients 
so that the solution of the differential equation is complex in 
general, turning real only at the stations originally chosen. A 
recurrence relation that corresponds to a complex-coefficient dif- 
ferential equation has only questionable physical significance and 
extrapolation by the use of such a recurrence relation must be 
viewed with suspicion. 

It is possible to determine the recurrence coefficients for half- 
intervals from a knowledge of the coefficients for the original in- 
tervals. Let the order of the recurrence relation be two and let 
the relation be given by 


Vi = Am-i -f A 2 yi - 2 (14) 


Similarly, the half-interval recurrence relation is given by 


Vi = aWi-i/i + (15) 

= o i y { -i 4- (hyi-t/t) + ch.Vi-\ 

Solving for y { -\/ 1 by means of 


DISCUSSION 
Burt M. Rosenbaum 2 

The authors are to be commended for devising a method of 
extrapolation which is both simple and widely applicable. As 
pointed out by the authors in comparing equations (12) and (13), 
this ease of application stems from the fact that the resulting 
equations for the unknown constants Ai and A 2 are linear in these 
constants whereas the Prony method of approximating the curve 
by a sum of exponentials gives rise to nonlinear equations. It 
is evident that the recurrence relation gives exactly the same ex- 
trapolated curve as would be obtained if the exponential solu- 
tion, as determined by the more complicated Prony method, 
were used for extrapolation. 

However, the Prony method does yield additional information 
in that it gives the entire curve over the range of the independent 
variable and not just points at intervals along the range. The 
Prony method actually determines the constants entering into the 
differential equation best fitting the data points. As an illustra- 

1 Nuclear Reactor Division, National Aeronautics and Space Ad- 
ministration, Lewis Research Center, Cleveland, Ohio. 


2/i-l — «l2/i- 3 A 4* 

and substituting in equation (15), one obtains the desired result 
Vi = (ai 2 + 202)2/, -i “ <h 2 yi-i (16) 

A comparison of equations (14) and (16) yields 


Ai = ai 2 + 2ct2 ) 



The above process can be continued indefinitely, each step giving 
the recurrence coefficients fo r dou ble the number of stations. If 
either A 2 > 0 or Ai 4 2 's/ — A 2 < 0, the new recurrence coef- 
ficients are complex indicating that the interpolated values of the 
ordinate, that is, the values of the ordinate at the new stations, 
are not real. In order to insure that the recurrence coefficients 
stay real at each step, which is equivalent to requiring that the 
differential equation possess a real solution, the inequalities 
A 2 < 0 and Ai + 2 V-A 2 >0 must be satisfied. Thus, condi- 
tions on the recurrence coefficients may be found which are 
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equivalent to requiring that the coefficients of the corresponding 
differential equation be real without actually finding these latter 
coefficients. 

The full-interval recurrence coefficients are given in terms of 
the half-interval coefficients by 

Ai = ai 2 -f 2a 2 

A 2 — 2a t a 3 — a 2 2 > 

A z = a 3 2 

for a three-term recurrence relation and 

A i = ai 2 -f ‘2a 2 
A 2 = 2a t a 3 + 2a 4 — O 2 2 
A 3 = a 3 2 — 2 a 2 a 4 

— — a 4 2 < 

for a four-term relation. Note that a necessary condition for an 
nth order recurrence formula to yield a real curve is apparently 

( — 1)M„<0. 

As a final observation, data points are inaccurate to some degree 
and in addition the recurrence relation that is established does not 
fit the data points exactly. But in order to extrapolate to the next 
station by the use of a recurrence relation of order q, it is neces- 
sary to know the values of the ordinates at the last q stations of 
the curve which as mentioned are somewhat in error. Would the 
authors care to discuss more fully how the extrapolated curve 
may be obtained once the recurrence coefficients have been de- 
termined? 

Authors’ Closure 

The authors wish to thank Dr. Rosenbaum for his illuminating 
comments. In particular, the equation relating the coefficients 
of the finite-difference recurrence relation to those of the cor- 
responding differential equation and the conditions for the latter 
coefficients to be real are of great interest. 

The significance of the fact that the coefficients of the differen- 
tial equation may turn out to be complex is not very clear. In 
any recurrence relation, values of the desired function can only be 
obtained at discrete points. Nothing at all can be said about the 
function in the region between successive points. The reason for 
replacing the continuous solution by one which is valid at only 
discrete points is to simplify the solution. The fact that the 
corresponding differential equation would give nonreal solutions 


between stations does not seem to be relevant. Thus, for example, 
examination of Figs. 6, 8, 9, 10, and 12 indicates that, although 
one of the conditions given by Dr. Rosenbaum for the coefficients 
of the differential equation to be real, namely, (~l)M n < 0, is 
violated in these cases, the extrapolations obtained were very 
good. 

For a gth order recurrence relation, the extrapolated curves 
will in general be sensitive to the last q ordinates of the original 
data curves. This is due to the fact that once the A { are de- 
termined, the last q values of the ordinates are used directly to 
begin the extrapolation. It is therefore important that these 
last q values be obtained in the best possible manner. 

If there is a sufficient number of data points in this region, 
with little scatter, then one can have confidence in the originally 
faired curve. If, however, such is not the case, it might be 
wise to investigate further the validity of the extrapolation. 
Thus, one could extrapolate to the desired point using the last q 
values as described. One could then successively repeat the 
extrapolation each time beginning at one station earlier. In this 
way a set of extrapolated values can be obtained. If all these 
values agree with each other fairly well, one could have some con- 
fidence in the final result. If, however, widely differing values 
are obtained for the extrapolated point, care must be taken in 
deciding which value to use. One could, for example, average 
the different values obtained, using an appropriate weighting 
factor for each one. 

In deciding on appropriate weighting constants, at least three 
important factors should be considered: (1) the number of sta- 
tions between the extrapolated point and the starting values on 
which they are based, (2) how well the faired curve fits the data 
in the region where the extrapolation is started, and (3) the num- 
ber of actual data points in this region. Thus it is obvious that 
the closer the extrapolated point is to the region where the extra- 
polation is started, the greater the number of data points in this 
region and the closer the faired curve fits the data in this region, 
the more weight should be attached to the resultant extrapolated 
value. Thus one could tentativel}' assume the weighting factor 
to be approximately inversely proportional to the number 
of intervals extrapolated, directly proportional to the number of 
data points in the region one is extrapolating from, and propor- 
tional to some function of the inverse of the deviation of these 
data from the faired curve. (A direct inverse proportion cannot 
be used for the deviation from the curve since this would lead 
to infinite weight for a data point right on the curve.) A detailed 
analysis of the type of weighting factors to be used could form 
an interesting future investigation. 
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